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During  the  period  July  1,  1983  to  June  30,  1984,  the  Principal  Investigator 
gave  an  invited  talk  on  "Life  Distribution  Properties  of  Devices  Subject  to 
Deterioration"  at  the  International  Semi-Markov  Processes  Conference  that  was  held 
at  Universite'  Libre  de  Bruxelles  under  the  auspices  of  the  Bemolli  Society. 
Moreover,  he  helped  in  organizing  the  session  on  Reliability  Theory  at  the 
conference.  He  co-edited  the  proceedings  of  the  conference  he  organized  on 
Survival  Models,  Maintenance  Policies  and  Life  Testing.  The  proceedings  will 
be  published  by  Academic  Press  Publishing  Company  under  the  title  "Reliability 
Theory  and  Models:  Stochastic  Failure  Models,  Optimal  Maintenance  Policies, 

Life  Testing,  Structure";  it  is  scheduled  to  appear  on  August  15,  1984.  He 
also  wrote  the  paper  "A  Power  Transformation  Exponential  Regression  Model  for 
Cencored  Failure  Time  Data"  with  Professor  David  Young  of  Brunei  University, 
England.  This  paper  is  to  be  submitted  for  publication  to  Ccrminications  in 
Statistics;  he  revised  the  paper  "Life  Distribution  Properties  of  Devices 
Subject  to  a  Pure  Jump  Damage  Prc  ..ess"  which  will  appear  in  the  December  1984 
issue  of  Journal  of  Applied  Probability.  He  is  in  the  process  of  writing  a 
paper  on  "Imperfect  Maintenance  Models"  which  will  be  submitted  to  Journal  of 
Operations  Research. 

The  Co-investigator  attended  numerous  seminars  and  work  group  sessions  on 
stochastic  processes  at  University  of  Paris  VI  between  March  15,  1984  and  June 
1,  1984.  He  wrote  two  papers: 

(1)  An  Iterative  Scheme  for  Approximating  Optimal  Replacement  Policies 

(2)  Stability  of  Optimal  Replacement  Policies 

The  first  paper  is  to  appear  in  Reliability  Theory  and  Models:  Stochastic 
Failure  Models,  Optimal  Maintenance  Policies,  Life  Testing,  Structures, 
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SUMiftRY 

OF  RESEARCH  CONDUCTES 

A)  LIFE  DISTRIBUTION  PROPERTIES  OF  DEVICES  SUBJECT  TO  A 
PURE  JUMP  DAMAGE  PROCESS.  Suppose  that  a  device  is  subject  to 
damage,  the  amount  of  damage  it  suffers,  over  time,  is  assumed 
to  be  an  increasing  pure  jump  process.  We  denote  such  a  process 
by  X  =  (Xfc/  t  >  0) . 

It  is  known  that  there  exists  a  Poisson  random  measure  on  R+  x  R+  whose  mean 

2 

meausre  at  the  point  (s,z)  is  ds  dz/z  and  a  deterministic  function  c  defined 
on  the  positive  quadrant  that  is  increasing  in  the  second  argument  such  that 

1  f(Xs-'Xs>  =  ;  N(ds,dz)  f  (X  ,X  +c(X  ,  z) ) 

- s<t  [0,t]xR+  s" 

almost  everywhere  for  each  function  f  on  R+  x  R+  with  f(x,x)  =  0  for 

all  x  in  R+.  In  particular,  if  follows  that 

X.  =  Xn  +  /  N(ds,dz)  c(X  ,z). 

*  °  [0,t]xR+  S_ 

The  above  formula  has  the  following  interpretation 

t  -*•  Xfc(w)  jumps  at  s  if  the  Poisson  random  measure  N(w,.)  has  an  atom 
(s,z)  and  then  the  jump  is  from  the  left-hand  limit  X  (w)  to  the  right-hand 
limit 

Xs  =  Xs-  +  c(Xs-'2)* 

The  function  c(x,z)  represents  the  damage  due  to  a  shock  of  magnitude  z 
occur ing  at  a  time  when  the  previous  cumolative  damage  is  equal  to  x. 

Assume  that  the  device  has  a  threshold  Y  and  it  fails  once  the  damage  exceeds 
or  equal  to  Y.  The  failure  time  is  therefore  given  by 
C  «  inf  {  t  :  >  Y  }. 

Let  G  be  the  right  tail  probability  of  the  randan  variable  Y.  Then  the  survival 
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function  is  given  by,  for  t  >  0, 

S(t)  =  P(S  >  t) 

=  E[G(Xt)] 

We  show  that  life  distribution  properties  of  G  are  inherited  as 
corresponding  properties  of  S.  The  following  are  samples  of  seme  of  the  results 
obtained: 

(1)  Theorem.  Suppose  that  the  function  c  above  satisfies  the  following 
condition 

c(.,z):R+  a-  R+  is  increasing  for  each  z  >  0. 

Then 

(i)  S  has  increasing  failure  rate  when  G  has  increasing  failure  rate  and 
X  has  a  totally  positive  density  of  order  two 

(ii)  S  has  increasing  failure  rate  on  the  average  when  G  has  an  increasing 
failure  rate  on  the  average  and  X  has  a  totally  positive  density  if  order  two 

(iii)  S  is  new  better  than  used  if  G  is  new  better  than  used 

(2)  Theorem.  Suppose  that  the  function  c  satisfies  the  following  condition 
c(.,z):R+  -*■  R+  is  decreasing  for  each  z  >  0. 

Then 

(i)  S  has  decreasing  failure  rate  when  G  has  decreasing  failure  rate  and 
X  has  a  totally  positive  density  of  order  two. 

(ii)  X  has  a  decreasing  failure  rate  average  when  G  has  a  decreasing 
failure  rate  average  and  X  has  a  totally  positive  density  of  order  two. 

(iii)  S  is  new  worse  than  used  when  G  is  new  worse  than  used  and  the 
function  x  ■*  x  +  c(x,z)  is  an  increasing  function  for  each  z  >  0. 

Furthermore,  if  the  threshold  depends  an  time  and  is  the  threshold  at 


time  t  >  0.  Then 
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S(t)  =  E  G(Xfc,t) 

where  G(x,t)  =  P(Yt  >  x)  for  x,  t  >  0.  in  this  case  we  obtain  the  following 
result 

(3)  Theorem  (i)  Suppose  that  G(.,t)  has  increasing  failure  rate  average  for 

each  t  >  0,  the  mapping  G(x, .)  is  decreasing  function  for  each  x  >  0,  X  has 

a  totally  positive  density  of  order  two,  and  c(.,z)  is  an  increasing  function 

for  each  z  >  0.  Then  S  has  increasing  failure  rate  average. 

(ii)  Suppose  that  G(.,t)  has  a  decreasing  failure  rate  average  for  each 

t  t  0,  the  mapping  G(x,.)  is  an  increasing  function  for  each  x  >  0,  X  has  a 

totally  positive  density  of  order  two  and  c(.,z)  is  a  decreasing  function  for 

each  z  >  0.  Then  S  has  decreasing  failure  rate  average. 

_  2 

(iii)  Suppose  that  V  =  -In  G  is  a  subadditive  function  on  R+  and  c(.,z)  is 

an  increasing  function  for  each  z  >  0.  Then  S  is  new  better  than  used. 

2 

(iv)  Suppose  that  V  above  is  a  subadditive  function  on  R+  vhile  the 
function  x  -*■  x  +  c(x,z)  is  decreasing  for  each  z  >  0.  Then  S  is  new  worse 
than  used. 

We  also  discuss  the  optimal  replacement  problem  for  such  devices. 

Define,  for  t  >  0, 


The  process  Z  =  (Zfc)  is  obtained  by  killing  the  process  X  at  the  failure  time 
of  the  device. 

A  device  subject  to  the  damage  process  Z  can  be  replaced  before  or  at 
failure.  Each  replacement  at  failure  cost  c  dollars,  c  >  0.  The  cost  of  a 
replacement  before  failure  depends  on  the  damage  level  at  the  time  of  replacement 
and  is  denoted  by  c(.) .  That  is  to  say,  c(x)  is  the  cost  of  a  replacement 
when  the  damage  level  at  time  of  replacement  is  equal  to  x.  Naturally,  we 


; 
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assume  that  c(x)  is  increasing  and  bounded  above  by  c.  Let  (Ht)  be  the 
canonical  history  of  2.  Moreover,  U  denotes  the  class  of  stopping  times  that 
do  not  exceed  the  life  time  5. 

For  any  stopping  time  t  in  U  we  let  denote  the  expected  cost  of 
replacement  per  unit  time.  We  are  interested  in  finding  the  stopping  time  t* 
in  U  satisfying 

r  =inf 
x*  TeU 

That  is  to  say,  we  want  to  find  the  stopping  time  in  U  that  minimuzes  the 
expected  cost  per  unit  time  over  U.  We  call  such  stopping  time  the  optimal 
replacement  time.  We  give  conditions  on  the  cost  function  c(x)  and  the  damage 
function  c  (x,z)  that  guarantee  that  the  optimal  replacement  policy  is  a  control- 
limit  policy. 

Hie  above  results  have  been  accepted  for  publication  in  Journal  of  Applied 
Probability  and  is  scheduled  to  appear  in  December  1984. 


B)  A  POWER  TRANSFORMATION  EXPONENTIAL  REGRESSION  MODEL  FOR 

CENSORED  FAILURE  TIME  DATA.  Suppose  that  we  have  n  items  which  are 

*  *  * 

subject  to  failure.  Let  T^,  T2»  . . . ,  be  the  random  variables 
representing  the  failure  times  of  the  first,  second,  ...,  n  th 
item  respectively.  We  assume  that  right  censoring  may  occur 
because  of  the  need  for  early  termination  of  the  experiment  and  let 
T^,  T2,  ...»  Tn  represent  the  recorded  survival  times.  Defining 
censoring  indicator  variables 

{* 

1  if  T.  is  uncensored 

. 

0  if  is  censored 


we  have 
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* 

T.  =  T.  if  W  =  1 
^  1  0 


* 

and  >  1\ 


if  =  0. 


We  let 


n  n 

n  =  I  w .  and  n  =  I  (1-w.) 
i=l  i=l  1 


denote  the  numbers  of  uncensored  and  censored  observations  respectively. 
Without  loss  of  generality  we  label  the  individuals  such  that  the  first 
nu  items  have  uncensored  times  to  failure  and  the  remaining  n^  have 
censored  tunes  to  failure. 

We  now  suppose  that  measurements  are  available  of  k  explanatory  variables 

xr  X^,  ...»  Xk.  Setting  x*  =  (x^.x^*  ...»  x^) ,  the  probability  density  function 

★ 

and  survival  function  of  T  given  x  are  denoted  by  f (t;x)  and  S(t;x) 

respectively.  If  the  failure  rate  does  not  depend  on  t,  for  any  given  x, 

* 

T  has  the  exponential  distribution  with  probability  density  function 


f  (t;x) 


u"1  exp  (-t/vx)  ,  t  >  0 
0  otherwise. 


Various  models  have  been  proposed  in  the  literature  to  represent  the 
dependence  of  wx  on  x.  Scite  suthors  consider  the  model  form 


jjx  =  A  (1  +  x’  8) 


while  others  use  the  form 
Vx  =  A/  (1  +  x'  8) 

where  J3'  =  (8^»  ...»  8^)  and  A  is  a  positive  constant.  Both  models  require 

that  the  condition  x'jS  >  -1  must  be  imposed  to  insure  that  wx  >  0.  An 
alternative  model  which  does  not  require  a  constraint  to  be  imposed  on  x'jS  is 


Px  ■  A  exp  {x’J3) 
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This  model  arises  for  the  exponential  case  from  the  well-known  family  of 
proportional  hazard  repression  models  in  which  an  assumed  underlying  hazard 
function  is  adjusted  by  multiplicative  exponential  factors  to  allow  for  the 
effect  of  the  explanatory  variables. 

In  this  paper,  we  consider  the  power  transformation  model  given  by 
ux  =  (1  +  6x'8)1/6 

We  refer  to  6  as  the  power  parameter.  It  is  seen  that  when  6  =  1,  the 
model  corresponds  to  the  first  model  discussed  in  the  previous  paragraph, 
second  model  is  obtained  after  appropriate  reparameterisation.  When  5  +  0 
the  exponential  model  for  given  above  is  obtained. 

In  general,  the  power  parameter  6  as  well  as  the  coefficient  vector  8 
will  have  to  be  estimated  from  the  data.  We  obtain  maximum  likelihood  estimators 
for  these  parameters  and  it  is  shown  how  the  estimates  can  be  obtained  using  the 
statistical  package  G  LIM.  We  also  discuss  the  assessment  of  the  goodness  of 
fit  of  the  model  and  numerical  examples  are  given  to  illustrate  the  procedure. 

C)  STABILITY  OF  OPTIMAL  REPLACEMENT  PROBLEMS.  In  this  work  we 
complete  and  considerably  extend  the  work  reported  on  in  preliminary 
fashion  in  section  1(D)  of  last  years  proposal.  Let  X  =  {Xt,  t  >  0} 

be  a  Hunt  process  with  state  space  E.  Let  X  be  stopping  time  for  X 

and  let  X  be  the  process  obtained  by  killing  X  at  X.  The  state 

space  of  X  is  new  EA  =  E  u{ A}  where  the  augmented  point  A  denotes 

"failure".  A  generalized  replacement  policy  is  a  Markov  time  which 

determines  a  system's  replacement  in  terms  of  its  history.  A 

generalized  e-optimal  replacement  policy  at  x  is  a  generalized  policy 

such  that  Exg(X_  )/Ex(t  )  is  within  e  of  the  minimum  long-run  average 
e 

cost  for  the  replacement  cost  function  g.  Here  E  denotes  expectation 
with  respect  to  the  process  X. 
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A  generalized  optimal  replacement  problem  (X,X,g)  (at  x)  is  termed  stable 
if  every  nearly  optimal  policy  for  the  problem  (X,X,g)  is  nearly  optimal  for 
any  "sufficiently  close"  problem  (X^,X^,g^)  and  vice-versa.  We  shew  that,  if 
life  times  are  not  permitted  to  vary  then  under  suitable  definitions  of 
"closeness  between  problsns" ,  optimal  replacement  problems  are  stable.  Examples 
shew  that,  when  lifetimes  can  vary,  such  is  no  longer  the  case.  When  X  is 
restricted  to  be  a  one  dimensional  wear/damage  process  and  the  lifetimes  are 
restricted  to  be  threshold  times,  it  is  shown  that,  if  the  threshold  is  one  which 
X  misses  with  probability  one,  then  every  problem  (X,X,g)  is  stable. 

These  results  have  been  submitted  for  publication  and  were  part  of  a  talk 
given  at  the  1983  Charlotte  conference  on  Stochastic  Failure  Models. 

D)  AN  ITERATIVE  SCHEME  FOR  APPROXIMATING  OPTIMAL  REPLACEMENT 

POLICIES.  let  X  =  Xfc/  t  >  0  be  a  stochastic  process  with  augmented 
A 

state  space  E  and  lifetime  X  =  inf  {t  |Xt  =  A}.  In  this  paper  we 
analyze  the  follwaing  iterative  technique.  Let  b^  =  E°g(X^) /E°(X) . 

Consider  the  problem  of  maximizing  the  criterion  i^(b^,;)  =  b-jE°(T)-E°g(X^, 
for  x  <  X.  If  we  are  interested  in  a  generalized  e -optimal  policy, 
then  tolerances  x  >  0  and  S  >  0  are  determined  in  terms  of  X,g,X  and 
e  so  that,  if  a  e-optimal  policy  for  ^(b^i)  gives  iMb^t)  5  a 

then  X  is  already  e-optimal,  otherwise  take  b2  =  E°g (X^  )  /E°  (x^) 

0  ^  o 

and  repeat  the  steps  on  the  criterion  ^(b2,x)  =  b2E  (t)  -  E  g(Xt). 

Under  very  reasonable  assumptions  on  g  (it  must  be  positive  and 
bounded  away  from  zero) ,  it  is  shewn  that  this  iterative  method  will 
supply  a  generalized  e-optimal  replacement  policy.  We  further 
implement  this  scheme  on  a  computer  for  certain  Markovian  damage  models. 

In  doing  so,  the  discrete  approximations  which  are  required  are  fully 
justified  and  some  feeling  for  the  speed  of  convergence  of  the  procedure 
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is  obtained.  The  iterative  schane  itself  is  very  fast.  Solving  the 
related  optimal  stopping  problems  using  dynamic  programming  techniques 
is,  however,  very  slow. 

This  work  constitutes  a  completion  and  considerable  extension  of  that 
reported  on  in  a  preliminary  fashion  in  section  1(E)  of  last  year's  proposal. 
The  iterative  scheme  itself  is  now  seen  to  work  for  artibrary  stochastic 
processes  (as  opposed  to  just  simple  wear  processes) .  The  justification  of  the 
discrete  approximations  required  in  the  associated  optimal  stopping  problems 
constitutes  an  effort  in  the  spirit  of  same  of  the  work  of  Whitt  but  applied  to 
a  problem  which  is  outside  the  framework  of  those  he  has  considered.  The 
numerical  implementations  and  simulations  also  represent  considerable  progress  on 
the  research  proposed  in  the  last  paragraph  of  section  11(E)  of  last  year's 
proposal . 

These  results  are  to  appear  in  the  proceedings  of  the  Charlotte  conference 
on  Stochastic  Failure  Models. 

E)  STABILITY  OF  OPTIMAL  STOPPING  PROBLEMS.  For  a  process  X 
and  a  reward  function  g  defined  on  the  state  space  of  X,  we  have 
defined  concepts  of  stability  of  the  optimal  stopping  time  (X,g)  in 
previously  reported  work.  Roughly,  (X,g)  is  center  stable  if  a 
close  to  optimal  solution  to  the  stopping  time  problem  (X,g)  is 
close  to  optimal  for  any  problem  (X^,g^)  which  is  sufficiently  "near" 
to  the  problem  (X,g) .  The  problem  (X,g)  is  termed  stable  if  close  to 
optimal  solutions  to  any  sufficiently  "near"  problem  (X^,g^)  are  close 
to  optimal  for  (X,g) .  There  are  two  new  things  to  report  here.  First 
we  have  shewn  that,  for  n  >  2,  Brownian  motion  in  Rn  is  not  stable. 

This  solves  (Xaestion  2  of  part  11(E)  of  last  year's  proposal.  We 
have  also  made  headway  in  better  understanding  the  metric  we  are  using 
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to  measure  distances  between  processes.  Recall  that,  if  X  =  (fl,  Mt,  M, 
p  ,et,Xt)  is  a  standard  process  in  the  usual  sense,  then  denotes 

the  set  of  standard  processes  Y  =  (ft,  W,  .  PXrl<-,X.).  For  X,  Y  c  Sv 

define  d(X,Y)  by 

d(X,Y)  =  sup  sup  |p*  (A)  -  pf  (A) | . 

0  x  y 
xeE  AeF^ 

We  recognize  d-convergence  as  being  convergence  in  total  variation 
on  initial  segments  F^.  In  the  literature,  weak  convergence  is  what 
is  normally  looked  at  when  one  wants  to  consider  different  processes 
to  have  the  same  path  space  but  different  measures.  However,  examples 
show  that  weak  convergence  is  not  strong  enough  for  any  kind  of  stability 
for  undiscounted  problems  with  discontinuous  reward  functions  (exactly 
the  setting  we  get  into  when  considering  optimal  replacement  problems) . 

What  we  have  established  about  d-convergence  is  that,  for  diffusions  with 
the  same  diffusion  term,  d-convergence  is  implied  by  uniform  convergence 
of  drift  terms.  However,  if  in  the  strictly  elliptic  case  the  diffusion 
terms  are  permitted  to  vary,  then  a  fairly  simple  argument  shows  that 
the  processes  are  singular  and  hence  as  far  apart  in  the  a-metric  as 
is  possible.  This  means  that  the  study  of  stability  within  the  class 
of  diffusions  is  far  from  ccnplete. 

For  compound  Poisson  processes,  the  situation  is  nice.  Parameter  convergence 
combined  with  convergence  in  total  variation  of  the  jump  distributions  is  enough 
to  get  d-convergence  for  these  processes. 
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